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REMARKS 

Claims 1-114 arc in the application. 

Claims 35-65 are elected for prosecution. The remaining claims have been withdrawn 
from consideration, res u king from a restriction requirement which has been made final. 

SECOND REQUEST FOR RECONSIDERATION 01- RESTRICTION REQUIREMENT 

Applicants ayain request reconsideration of the withdrawal from consideration of claims 
1-34 and 66-1 14, since the filing of these claims evidences an intent to claim the subject matter, 
and since the effective filing date for these claims is senior to the patent(s) from which they are 
copied. 

The Exn miner relies on the fact that MPEP 2303.01 relates to interferences between 
pending applications as a basis for refusing to consider whether, in fact, an interference should 
be declared with respect to the non-elected claims. While it appears to be true that there is no 
corresponding MPiiP section to 2303.01 for an interference between an explication and an issued 
patent, it is not true that this leads to a conclusion that the restriction is nevertheless proper. The 
policies and principles embodied in the applicable rules (37 C.F.R.) and laws (35 U.S.C.) 
necessarily lead to the conclusion that the issues are the same, and therefore that, upon evidence 
of applicant's intent to claim the same subject matter as that in an issued patent, the Office 
should, with special dispatch, seek to determine whether an interference should be declared. 
This policy therefore dictates that the interference issues arising in divisible inventions be 
addressed immediately, and not be deferred as a result of a restriction or election requirement. 
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FORMAL REJECTIONS 

Claims 36-39, 41-46, 48-54, 56, 57. and 59-65 arc rejected under 35 U.S.C. § 1 12, first 
paragraph, as allegedly containing subject matter which was not described in the specification in 
such a way as to reasonably convey to one skilled in the relevant art that the inventor(s), at the 
time the application was filed, had possession of the claimed invention. Applicants provide 
below their proffered evidence with respect to support for the dependent claims. 

The provided chart is not intended to be limiting, nor to necessarily interpret nor limit 
claim interpretation. Efforts have been made to limit the number of discreLe passages referenced, 
in order to make the Examiner's analysis more efficient. Passages which particularly relate to 
the deficiencies noted by the Examiner are non-repetitively highlighted. 

It is more generally noted that the discussed "correlation index" is inherently a ranking. 
(See claim 36), The target profile summary corresponds to the analysis and characterization of 
the signal, which are automatically generated, (See claims 48 and 56). Content profiles a similar 
to target profile summaries: these result from cither manual or automatic characterization ot the 
content, each of which is disclosed in the specification, (See claims 51, 52. 59, 60 and 64), The 
specification discloses both (racking of user interaction history, which inherently encompasses 
frequency of selection, as well as directly discussing "frequently used choices". Further, the 
specification discusses classification of a user, e.g.. "novice", and their expected characteristics. 
The system determines user class characteristics, such as frequency of selection, and uses these 
in processing the user history data to make predictions. As such, each customer profile is 
updated "to reflect" the frequency of selection of the data sources by customers with customer 
profiles substantially similar to each customer profile. (See claim 54). 

The Examiner is respectfully requested to particularly respond to any noted deficiency. 
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ART REJECTIONS 

Claims 35-40, 47. 48. 50-52, 54-56. 58-60 and 63 arc rejectee! under 35 L'.S.C. $ 103 as 
being obvious in view of Youriek el al. (US 4.775.935), further in view of Lockwood (US 
4.567,359), 

Claims 35 and 40 arc amended to provide that the content records are related to a stored 
user profile accordin g to a likely decree of interest . This limitation is drawn, for example, from 
claims 36 and 41 , and finds support throughout the specification. 

The Examiner agrees that Youriek et al. is deficient with respect to the rejected claims in 
that it does not teach persistent storage of user-specific data. The Examiner therefore cites 
Lock wood to supply the missing teachings. In feet. Lockwood does teach the well known 
proposition that user-specific files or "profiles" may be stored electronically. This, however, 
does not remedy the deficiencies of Youriek et al.. especially in view of the amended claims 35 
and 40. 

In particular, these references together do not provide an enabling disclosure, allowing 
one of ordinary skill in the art at the time the invention was made, to make or use the invention. 
In particular, neither reference teaches or suggests how user-specific, persistently stored data 
may be used to relate a degree of i mere si or user preferences. Youriek et al. teach a system 
which operates on population preferences, without regard to user identity or characteristics. 
Lockwood docs not relate to interests or preferences at all. There are a number of impediments 
lo constructing a system which accounts for long-term inter-user variability, which are neither 
taught nor suggested by the references. 

One particular problem presented by the Youriek et al. model is that it initializes each 
user without regard for demonstrated interests or preferences. However, the system is apparently 
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intended to promote a k *llrst sale": if it were to store a user history, it would have to predict. 



based on both explicitly expressed preferences (user feedback) and implicitly expressed 
preferences (consummated sales), a subsequent interest or preference of a user. However, this 
leads to a further inquiry, for example, into the role of the user. Is the item a gift? Does a person 
need two toasters? How lony does a toaster last, such that an inferred negative preference for 
buying a second toaster becomes a positive preference to replace the old toaster? Etc.... 

One result of persistent user-specific profiles which are used to in fer interest or 
preferences is that the database grows continually. Yourick et al. describe a system in which the 
database does not appreciably grow through use. Lockwood describe that a "quotation history 

file stored in memory is up-dated " However, Lockwood does not describe at all how this 

stored quotation history file is used, nor docs it suggest a purpose therefore. Fig, 6 may be 
interpreted to indicate that the '"history file" is used to "locate prior quoted and therefore is in no 
way updated by user feedback or involved in determination of user interest or preferences. 

Applicants therefore respectfully submit that the combination of Yourick el al. and 
Lockwood fail to render the present claims obvious. Reconsideration of the rejection is 
respectfully requested. 




Steven M. Hoffbcrg 
Reg, No, 33,511 



MILDE & HOFFBERG. LLP 
1 0 Bank Street - Suite 460 
White Plains, NY 10606 
(914)940-3100 
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APPLICATION 
CLAIM 
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FIGS 


SPEC. 
Page:Line 










36. The apparatus 
according to cliiim 35. 


i 






i wherein said apparatus 
is an in form ni ion 
access system lor 
automatically 
presenting users with 
information items of 
interest: 

wheivin said content 
records storing means 
comprise^ a computer 
system containing n 
database of 
in for marl oil items 
available to be 
presented lu users of 
the bysrem: 

i 


I The "smart screen" aspect of the present invention is further 
explored in the present example. This aspect of the invention 
allows the interlace to anticipate or predict Hie intent of the user, 
to provide, as a default, the most likely action to be taken by the 
user of the programmable device as a default, which may be 
cither accepted or rejected by rhe user, without delay to the user. 
The intelligent selection feature may also automatically choose 
an option and execute the selected option, without further 
intervention. 


risi. 

17. 

1703 


159: 15-23 


It is also noted char the present technology could also be applied 
to any sort of mass storage, such as for a personal computer. In 
such a case, a characteristic of the com purer tile, which \b 
analogous to The broadcast program in temporary storage of a 
VCR, is classified according to some criteria, which may be 
explicit, such as an explicit header Or identifying information, or 
implicit, such as a document in letter format, or a memorandum, 
as well as by words and word proximity. In particular, such a 
recognition system could differentiate various clients or authors 
based on the content of rhe document, and these could be stored 
in different manner. The text analysis system of a text- based 
computer storage system is analogous to die program 
classification system of the VCR embodiment of the present 
invention. However, there is a further analogy, in that The VCR 
could incorporate optical character recognition of text displayed 
in the program material or directly receive ce\t information us a 
part of a closed caption or videotex*; system, Thus, the VCR 
device of the present invention could recognise and classify 
programs based on textual cues, and make decisions based oil 
these cues. This might also provide u simple method of 
discriminating program material, for example, if a commercial 
does not include close caption or Second Audio Program (SAP), 
while the desired program does, or vice versa, then a commercial 
could he discriminated from n program with very little 
computational expenditure. 

The smart screens may be implemented as follows. The 
controller may be. for example, a Macintosh ci computer, 
operating under Macintosh 7.0 operating system. The HyperCard 
2.0 software may be used to implement lite screen interface, 
which incorporates the above-described features, which is 

iif*rw^ 1 1 w < 1 f'n 1 1 rS'*! f t l*\lr* iinln till* I— I\/n/'»i*rt 11 \ai **ir* • »v< tiIv / 1 

i^iiLi tiny uui iijJtLUiJtL vviLii uit. tiyy\,i [mu rtuiiWhirL. cilnli JIJ\-U 

above. HyperCard is mentioned due to its capabilities to 
reference external programs, thus allowing interfacing to various 
software and hardware devices, A more global scripting 
language, such as Frontier by UserLand Software Inc., may also 
be used, especially where low level hardware control of 
interfaced devices, such as a VCR, multimedia adapter, or the 
like is desired. Other scripting languages include versions oJ" 
KtiXX, by HUM, available on many platforms. The input device 
is an Apple ADB mouse, and the Output display is an 8 bit or 24 
bit graphics color adapter connected to, e.g., a M" color monitor. 


241 1 

i 


122:6-25 
! 123:1-4 
160:22-25 
161:1-15 
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APPLICATION 
CLAIM 



wherein snid accessing 
means comprises al 
least one access device 
for enabling users to 
communicate with the 
computer system and 
access any of the items 
of available 
information; 



SPLCK'ICA I ION SUPPORT 



In addition, various parameters concerning the use of the 
interface are stored in the computer's memory, and to :i 
non- volatile mass storage device, such as a hard disk drive, or 
bKPKOM or LP ROM, as well as baltery backed RAM could nlso 
be used. 



FIGS 



A Genius™ Mouse was used as the inpul device in the prototype 
of the interface of the present invention. With the mouse, the 
user could view all of the choices at once on the display screen, 
and then make a selection from the items on the screen by 
moving the cursor and then pressing ihe left mouse burton. 



wherein said user 
profile storing means 
store* a user profile for 
each user having 
access to the available 
items of information; _ 
wherein said relating 
means comprises 
means for ranking the 
likely degree of 
interest for each of the 
jivailnblo items of 
information in 
accordance with a user 
prolile; 



!n the ease of a single user or group of users, the interface could 
maintain a history of feature usage for each user, as in the past 
user history block 2107, and provide a lower user interface level 
for those lea lures which are rarely used, and therefore less 
familiar to the user, through the current user level output 2101. 



where in said 
presenting means 
presents the items of 
in formal ion lo an 
access device in order 
of ranking nnd 
enabling a user to 
retrieve each item: 



means for correlating said characterized content of the 
program material wjtli said deter mined viewer pre ft- re nee lo 
produce a correlation index: and 

means for presenting the program material to the viewer, if said 
correlation index indicates a probable high correlation between 
said characterization of the program material and said viewer 
preference. 

A user preference and event correlator 2412 produces an 
output relating to a rclatcdncss of an event or prospective 
event and a user preference. 

The interface would then search its databases regarding the user 
and broadcast listings to present :i most likely choice, as well as 
all available alternatives. In this case, the user history is of liitte 
help, and is nor. used to predict. In other cases, die system would 
use its intelligence to "till in the blanks", which could, of course, 
be rejected by the LisCr. 

wherein said control means receives a programming preference 
indicating a desired event from said input device which does not 
unambiguously define Siiid event, and said control means 
monitors said data and causes the occurrence of the action when a 
correlation between said pros-vammin" preference and said 
monitored data is above a predetermined threshold, indicating a 
I ikei v occurrence of said desired eveni. 



Menu options are preferably displayed in logical order or in their 
expected frequencies.,.. I fall selections cannot be displayed ai 
once, a hierarchical sequence is preferably used. 

A Gcnius m Mouse was used as the input device in the prototype 
ol ihe interface of the present invention. With cho mouse, the 
user could view till of the choices at once on the display screen, 
and then make a selection from the items on the screen bv 



SPRC. 
Pane: Line 



2410 



I28:U6 



2*106, 
1701 



107:14^19 



2406, 
2 1 07, 
21 1 L 
21 16, 
2208 



66:23-25 

67:1-4 

163: 12- 15 

166:14-20 

62:4-10 

66:23-25 



2405 



03:12-2:") 

94:1-10 

128:1-6 

180:18-23 

210:23-25 

211:1 
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moving the cursor and then pressing the left mouse button. 

... 't he interface would hierarchically present the available 
choices to the user, based on n probability of selection by the 

USLT.... 

The control 2601 also has an input device 2604. an on-screen 
display interlace 2605, and a program memory 2606, lor 
inputting instructions from a user, providing feedback to the user, 
and recording the result of the user interaction, respectively. 




63:21-25™ 
69:1 


where in said feedback 
nice i villi* means 
comprises means IVir 
cnLihlinu the tt.sor to 
indicate that user's 
interest in each 
retrieved item of 
information: unci 


It is n still further object of* the present invention to provide n 
system, further comprising means for storing a characterization 
of the program material, further comprising feedback means for 
inputting a feedback signal from the viewer indicating a degree 
of agreement with said presented stored program material. 


1705. 
1704 


wherein *aid updating 
means comprises 
menus tor updating the 
user's pro ill e in 
response to indications 
of interest provided by 
the user. 


wherein said feedback signal and said stored characterization are 
used by said viewer preference determining means to determine a 
new viewer preference. 


1707 


69:1-3 








37. The apparatus of 
claim 36. wherein said 
rankim: means ranks 
the available items of 
information for a user 
on ilie basis of at least 
one attribute porta mini: 
to each hem of 
in fori nation. 


...Such an array processor may be suitable for parallel analysis ol" 
the image segment and classification of its attributes. 


2207, ' 172:23-25 
220S. j 
2409, : 

2-107, 1 
2414, 
24 1 3 ' 






}H. The apparatus of 
claim 37. wherein said 
attribute is the contents 
of the item of 
in formation. 


...As noted above, these processors may also serve other 
functions such as voice recognition for the interface, or extracting 
text from video transmissions and interpreting it. 


241 1. 
2408, 
2501. 
2505, 

r-ia- 

10 


173:12*14 






170*1, 
1703, 
21 16, 
2208, 
2304, 
2305 


Ts:2-20~" 


30, The apparatus of 
claim 36. wherein said 
ranking means 
produces a formula 
which predicts the 
interest of a user in an 
item of in lorn ml ion on 
the basis of at: leasi one 
of a user profile and an 
atiributc related to rhat 


means for preprocessing the program material to produce a 
reduced data How information signal retaining information 
relating to a character of the program material and eliminating 
data not necessary to characterize the program material; 
means for characterizing said information signal based on its 
content: 

means for correlating said characterized content of said 
information signal with said determined viewer preference to 
produce a correlation index; and 

means for presenting said stored program material to the viewer, 



19 



Received from < 914 949 3416 > at 8/6103 2:41:07 PM [Eastern Daylight Time] 




Rug 06 03 01:50p Milde & Hoffberg, LLP t914J 949-341G p*24 
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CLAIM 


SPFf'JFlf* ATIOK SI : PPORT 
o i i r ]^/\ i 1 1/ in . i w i i v j i\ i 




< P l-Y* 

Paiie.Lme 


! item ol in formation. 


if said correlation index indicates a probable high correlation 
between said characterization of said information signal and said 
viewer preference. The system may also include a means for 
storing said information signal, wherein said characterizing 

mf-vint rhnrnr ti > ri7f* , * , c <crtirl <5tnr(*H intnrmnrinuT cioinl ;mrl ilcn i 

1 111*4,1 1 1> VI HH <l V 1 V <<iV? OUl^l OlUI 11 1 IS.'! 1 1 UK 1 Vl 1 Ul 1 , til 1 LI il \\ 

memory for storing Ihe program material while said 
characterizing means produces characterized content and said 
correlating means produces said correlation index. 














4 1 . The method 
according to claim 40, 
for providing 
information to users of 
n computer system, 
wherein: 








so id content record 
storing step cinnpi'iscs 
storing items of* 
informal ion in an 
unstructured database 
within the computer 
system: 


The use of on-line diUaba.se listings may be used by the present 
interface to provide information to be downloaded and 
incorporated in the index entry of the library function, and may 
also be used as part of the intelligent determination of the content 
of a broadcast. This information may further be used for 
explicitly programming the interface by the user, in that the user 
may be explicitly presented with the available choices available 
from I he database. 

In the present invention, an area of the tape, preferable at the 
beginning oft lie tape or at multiple locations therein, is encoded 
to hold information relating to the contents of the tape. This 
encoding is shown in ( ; ic. 19, which shows a data form.it for the 
information. This format has an identifying header 190 La 
unique tape identifier 1902. an entry identifier 1903, a start time 
1904. an end time 1905 and/or a duration 1 906, a date code 1907, 
a channel code 1908, descriptive information 1909 of the 
described entry, which may include recording parameters and 
acaial recorded locations on the ttipe, as well as a title or episode 
identifying information, which may be a fixed or variable length 
entry, optionally representative scenes 1910, which may be 
analog, digital, compressed, or related lo Hie abstract 
characterizations of the scenes formed in the operation of the 
device, l-'inally, there arc error correcting codes 1911 for the 
catalog entry, which may also include advanced block encoding 
schemes to reduce the affect of non-Gaussian correlated errors 
which may occur on video tape, transmission media and the like. 


1909, 

1910, 

2204. 

2206, 

2304, 

2407, 

250, 

261 I, 

2607 

T70L 
1 702, 
1803, 
2509. 
lSt)6a 


186:16-23 . 
(81:12-25 : 
182:1-4 1 

To^n-Vo 


said user profile 

MUl HILL ML JJ IUIII[JI 1 3V^ 

determining and 
storing tiser profiles 
lor users of the 
computer system who 
have access to the 
items of information: 


In the case of a single user or group of users, the interface could 

iti 'i i nt:i in :i hi^ftirv <i(* Itvrl nri 1 lor t*nf*li n^.tM* n< in rho nn^t 
user history block 2107. and provide n lower user interface level 
for those features which arc rarely used, and therefore less 
familiar lo the user, through the current user level output 2101. 


said receiving a 
request step comprises 
receiving a request 
j from n user for a e cess 


Another object of the present invention provides a programmable 
information storage apparatus having a data input, for receiving 
data to be stored, said apparatus receiving instructions from a 
programmer and causing an action to occur on the receipt of dnra 


[501, 
1602, 
1705, 
1706, 


63:8-25 
170:1-10 
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to the stored 
information; 


indicating an event, comprising: 

means for storing data from said data input: 

an input device, producing an input instruction signal; 

a control means for receiving said inpuL instruction signal, and 

storing a program instruction associated with said input 

instruction signal, said control means storing sufficient program 

instructions to perform an action on the receipt of data Irom said 

data input indicating an event, said control means monitoring the 

data input redetermine the occurrence or' various events. 

comparing the determined events with the program instructions, 

and performing for storing the do tn said action on the occurrence 

of said event; 

A further example of the use of the advanced intelligent features 
of the present invention would be if the user wished to record* 
e.g., "live" musical performances. These occur on many "talk" 
shows, such as "Tonight Show witli Johnny Carson" (NBC, 1 1 :30 
p.m. to 12:30 p.m.. week nights). "Saturday Night Live" (NBC 
I 1 :30 p.m. to 1 :00 a.m. Saturday- Sunday), and other shows such 
as the "Grammy Awards". The interface, if requested to record 
such performances would seek to determine their occurrence, by, 
e.g.. analyzing a broadcast schedule, by, e.g., interacting with the 
on-line database 241 1. and the local database 2413. 


IK1L 
21 10, 
2305, 
2401. 
2500. 
2604 




said re luting sLep 
comprises determining 
the user's likely decree 
of interest in kerns of 
information stored in 
said diiiiibu.se. in 
accordance with that 
user's profile, and 
ranking the items of 
information in 
accord once wlrh their 
determined degrees of 
interest: and 

1 
1 


means for correlating said characterized content of the program 
material with said determined viewer preference to produce u 
correlation index; and 

means for present ing the program material to the viewer, if said 
correlation index indicates a probable high correlation between 
said characterization of the program material and said viewer 
preference, 

A user preference and event correlator 2412 produces an output 
relating to a rclatedness of an event or prospective event and a 
user preference. 

wherein said control means receives a programming preference 
indicating a desired event from said input device which does not 
unambiguously define said event, and said control means 
monitors said data and causes the occurrence of the action when a 
correlation between said programming preference and said 
monitored data is above a predetermined threshold, indicating a 
likely occurrence of sit id desired event. 

means for correlating said characterized content of the program 
material with said determined viewer preference to produce a 
correlation index 


1506. 
1 509, 
1703, 
2116, 
2208. 
2412 


66:23-25 

67:1-4 

163:12-15 

62:4-10 

66:23-25 


said presenting step 
comprise* displaying 
Hie items of 
information with an 
indication of their 
relative rankings. 


The interface would then search its databases regarding the user 
and broadcast listings to present n most likely choice, as well as 
all available alternatives... 

i 


1505, 
1703. 
21 16. 
2208, 
2412 


166:14-20 










-12. 1 he method of 


Menu options are preferably displayed in logical order or in their 


03:12 
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" figs'"" 


SPLC. 
. Page: Line 


claim 1 1. wherein said 
items of information 
arc displayed in order 
of their runkin^. 


expected frequencies. 

Further, a number of most probable choices may be presented 
simultaneously or in sequence, in order to improve the 
probability that the user will be immediately or quickly presented 
with an acceptable choice. 

The interface would then search its databases regarding the user 
and broadeasr listings ro present a most likely choice, as well as 
all available alternatives. 

The use of on-line database listings may be used by the present 
interface to provide information to be downloaded and 
incorporated in the index entry of the library function, and may 
also be used as part of The intelligent determination of the content 
of a broadcast. This information may further be used for 
explicitly programming the interface by the user, in thai the user 
may be explicitly presented with the available choices available 
from the database. 




162:10-13 

166:14 

186:16-23 

i 








4.1. The method of 
claim 4 1 . wherein the 
user pro tiles and the 
determined decree of 
interesl in items of 
information are based 
upon tit least one 
attribute associated 
vviih each item of 
information. 

• 
i 


figure 24 shows a system for correlating a user's preferences 
with ;i prospective or real-time occurrence of an event. The input 
device 240 1 , which is a remote control with a pointing device, 
such as a trackball, provides the user's input to the control 2402. 
The program is stored in a program memory 2403, after it is 
entered. The control 2402 controls a plant 2404, which is a VCR. 
The control also controls an on-screen programming interface 
2405, through which the user interactively enters The program 
information. Each program entry of the user is submitted to the 
user history database and preferences module 2406, which may 
also receive explicit preference information* input by the user 
through the input device 2401, The prospective and real time 
event characterization unit 2407 uses any and all information 
available in order to determine the character of a signal input, 
which is a video signal, from the signal receiver 2408. A signal 
analyzer 2409 provides n preliminary analysts and 
characterization of the signal, which is input to the prospective 
and real time event characterization unit 2407. The prospective 
and real time event characterization unit 2407 also interacts and 
receives an input from a telecommunication module 24 10, which 
in turn interacts and receives information from an on-line 
database 24 1 1. A user preference and event correlator 24 1 2 
produces an output relat ing to n relateclness of an event or 
prospective event and a user preference, lit the event of a hi;;h 
correlation or re luted ness. the conrrol 2402 determines that the 
event or prospective event is a likely or most likely predicted 
action. The prospective event discussed above refers to a 
scheduled event, which is likely to occur in Hie future. The 
characterization unit also has a local database 241 3 for storing 
schedule information and the like. 


2106, 
2206, 
2304. 
241 L 
2412. 
2505, 
2607 


162:17-25 
163:1-20 






241 L 
2408, 


"172:23-25' 


44. The method or , ...Such an array processor may be suitable for parallel analysis of 
claim 43, wherein said | the image segment and classification of its attributes. 
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FIGS 


SPFX. 
P*uze:Line 


attribute is Che com Lent 

of the item of 
info mini ion. 




2507, 
2505, 
Fig. 
19 












45. The method of 
chum 4 1 . further 
including ihc stops ol 
selecting an item of 
information from tJ10.sc 
which ure displayed, 
providing an indication 
of the user's actual 
in 1 crest in the selected 
item oT information, 
and storing the user's 
indicated interest. 


It is a still further object of the present invention to provide a 
system, further comprising means for storing a characterization 
ol ilie program material, lurther comprising feedback meant; for 
inputting a feedback signal from the viewer indicating a degree 
of agreement with said presented stored program material, 
wherein said feedback signal and said stored characterization are 
used by said viewer preference determining means to determine a 
new viewer preference. 


1707 


GS:2l-25 
69: 1 -3 










46. The method of 
claim 4 1 . wherein the 
likely degree of 
in teres 1 is determined 
for all of the items of 
information stored in 
said database in 
response to reccipr of a 
user's request for 
access. 


The interface would then search its databases regarding the user 
and broadcast listings to present a most likely choice, as well as 
all available alternatives. 


2208 


166: 14-16 








48. The method of 
claim 47, for providing 
a user with access to 
selected ones of a 
pi 11 ry lily of iar«ci 
objects utid sets of 
target object 
characteristics that ate 
accessible via an 
electronic storage 
media, where said 
users are connected via 
user terminals and data 
communication 
connections to a target 
server system which 
; accesses said 
• electronic storage 
! medio, wherein: 

i 
1 


Figure 24 shows a system for correlating a user's preferences 
witii a prospective or real-time occurrence of an event. The input 
device 240 E. which is a remote control with a pointing device, 
such as a trackball, provides the user's input to the control 2402. 
The program is stored in a program memory 2403, after it is 
entered. The control 2402 controls a plom 2404. which is a VCR. 
The control also controls an on-screen programming interface 
2405, through which the user interactively enters the program 
information. Each program entry of the user is submitted to the 
user history database and preferences module 2406. which may 
also receive explicit preference information, input by the user 
through the input device 2401. The prospective and real time 
event characterization unit 2407 uses any and all information 
available in order to determine the character of a signal 
input, which is a video signal, from the signal receiver 2 4 OS, A 
signal analyzer 2409 provides a preliminary analysis and 
characterization of the signal, which is input to the 
prospective and real time event characterization unit 2407, 
The prospective and real time event characterization unit 
2407 also interacts and receives an input from a 
telecommunication module 2410, which in turn interacts and 
receives information from an on-line database 241 1 . A user 
preference and event correlator 2412 produces an output relating 
to a relntedncss of an event or prospective event and n user 


Fin. 

2005, 
22 1 0, 
2503 

2411 
24 1 0, 
2408 

i/i 1 n 

24 I 0 


162:17-25 
163:1-20 
1 15:23-25 
1 16:1-4 
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CLAIM 


SPbCIFICATJON SUPPORT : FIGS 


SPliC. 
Page: I, i ne 


preference. In the event of a high corn: tali on or relaledness, the 
control 2402 determines that the event or prospective event is a 
likely Or most likely predicted ucLion. The prospective event 
discussed above refers to a scheduled event, which is likely lo 
occur in die future. The characterization unit also has a local 
database 2413 for storing schedule information and the like. 

Thus* one embodiment of the device may incorporate o memory 
for storing a program, before being transferred to a permanent 
storage facility, such as tape. Such a memory may include a hard 
disk drive, magnetic tape loop, a rewritable optical disk drive, or 
semiconductor memories, including such devices as wafer scale 
memory devices. This is shown diagrammatical ly as the 
intermediate storage 22 10 of fig. 22. 






said automatically 
generating seep 
.iion crates at least one 
user target pro lilc 
interest summary lor a 
user at a user terminal, 
each of said user target 
profile interest 
summary being 
indicative of ones of 
said large: objects and 
sec* of rather object 
characteristics 
accessed by said user; 
and 


In die case of a single user or group of users, the interface could 
maintain a history of feature usage for each user, us in the past 
user history block 2 107, and provide a lower user interface level 
("or those features which are rarely used, and therefore less 
familiar to the user, ihrough the current user level output 2101. 

The system next must determine what function rhe user wishes ro 
perform. In this regard, if more than one user has access lo the 
system, the user identifies himself to the interface, in a user 
identification step 1701 or an analogous action, which may be a 
coded entry, or a selection from the menu. If the interface has 
voice recognition capability, then the user may be recognized by 
his voice pattern, or merely by stating his name. The interface 
then accesses the memory for a profile of the past use of die 
machine by the user, which may include die entire prior history, 
relevant abstracts of the history, or derived user preferences, as 
shown in the personalized startup based on user profile step 1702, 
which information is also stored and used in the past user history 
determining clement 2 107. These choices differ in the amount of 
storage necessary in order to retain the desired information. 

Having demonstrated a preference for "Married with Children", 
the interface would then characterize the program. This would 
include, for example* a characterization of (he soundtrack. 
Hie background, foreground, nctors and actresses present, 
credits, etc. The interface would then attempt to correlate the 
features present in The reference selection with other available 
selections. This comparison may be with a pre formed database, 
providing immediate results, or prospectively, alter entry of the 
re fc ren ce se 1 c e t i oi i . . . . 


Fig. 
2L 
2107 


107:14-19 

165:7-21 

167:13-21 


said ■storing step stores 
sii id ul least one user 
target profile interest 
sum m my in a memory. 


When the programming is completed, the inter luce must then 
update its user database, prompt the user to set the VCR to 
record, by, e.g., inserting a blank or recordable tape. 


1707 


167:2-4 










49. The method ol" 
claim 48. further 
comprising rhe steps 
of: 








enabling said user 10 


Thus, if the user has only used the VCR to record, e.g., the NBC 


Figs. 


165:22-25 
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CLAIM 



access said plural iiy of 
turner objects and sots 
of la r gel object 
characteristics stored 
i>n said electronic 
storage media via said 
user target profile 
interest summaries. 



SPECIFICATION SUPPORT 



sn id slop of enabling 
access comp rising: 



1 1 o'clock news, i.e.. record all days from I 1:00 p.m. to 1 1:30 
p.m. on NBC. in the past, Lhe most likely current predicted choice 
would be the NBC 1 1 o'clock news. If the interface were to 
present a number of choices, having lower probability, then it 
would interpret the recording history to be "news" based on u 
database of broadcast information. Therefore, a prediction of 
lower probability would be ABC or CBS news aL e.g., I 1 :00 
p.m., and the NBC news at, e.g., 5:00 p.m. Thus, these three 
choices would be initially presented fo the user, along with a 
menu selection to reject these predicted choices. In this case, the 
user would select the "reject" selection, and would be presented 
with a next predi cted de sired menu choice..,. 



FIGS 



15, 

21, 
2305 



SPJiC. 
Page:Line 



166:1-9 



correlating said user 
Larget profile imprest 
summaries, generated 
lor said user, with 
large i profiles 
generated for said 
plurality of target 
objects and sets of 
target objeci 
characteristics to 
identify ones of said 
plurality of target 
objects and .sets of 
largci object 
characteristics stored 
on said electronic 
storage media that arc 
likely to be of i me rest 
lt> said user; 



A user preference and event correlator 24 12 produces an output 
relating to a relulcdncss of an event or prospective eveni and n 
user preference. 



transmitting a list; thai 
idem i lies al least one 
of said idem i lied ones 
of *aid plurality of 
target objects and set* 

i of target object 

| characteristics, ro said 

; user: and 



providing access to a 
selected one of said 
plurality of target 
objeels and sets of* 
target objeci 
characteristics stored 
on said electronic 
storage media in 
response lo said user 
selecting an item from 



Tints, if the user has only used the VCR to record, e.g., the NBC 
I I o'clock news, i.e.. record all days from I l;0() p.m. to 1 1:30 
p.m. on NBC, in the past, the most likely current predicted choice 
would be the NBC I I o'clock news. If the interface were to 
present a number of choices, having lower probability, then it 
would interpret the recording history ro be ''news" based on a 
database of broadcast information. Therefore, n prediction of 
lower probability would be AUC or CBS news at, e.g., I 1 :00 
p.m., and the NBC news al, e.g.. 5:00 p.m. Thus, these three 
choices would be initially presented lo the user, along with n 

jiien.u selection to reject these predicted choices. 

In this case, the user would select the "reject" selection, and 
would be presented with a next predicted desired menu choice. 
Since the user history, in this case, does not provide for another 
choice of high probability, the user would be prompted to 
explicitly choose the program sequence by day, time, channel, 
and duration. The user would then enter the starting Lime for 
recording according to the methods described above..., The user 
then selects one of the available choices, which would complete 
the programming sequence. I f no database of broadcasts is 
availa ble, then the user must then explicitly define all parameters 



2412 



163: 12-15 



2105 



[65:22-25 
166:1-7 



figs. 
15, 17 



166:7-25 
167:1-2 
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FIGS 


SPEC. ' 
Page: Line 


5»n id list: 


of l he broadcast. 






said stop of providing 
access tun her 
• Comprising: 








. transmitting data, in 
response to said user 
activating said user 
terminal to identify 
said selected item on 
said list, indicative of 
said user's selection of 
said selected item from 
said user terminal to 
said target server via a 
one of said daw 
communication 
connections;: 

ret l ie vi nji, in response 
U) receipt of said data 

It'i'til^ v" ii ;"l ii vim' 

terminal* a one of a 
la rget object and sel of 
target object 
characteristics 
idem i fled by said 
selected item from said 
electronic storage 
media; and 


The present invention also allows encryption und decryption of 
material, much as the Vidcocipher series systems from General 

! Instruments, nnd the fractal enciphering methods of EMC2 and 
Iterated Systems, Inc. The present invention, however, is not 
limited to broadcasts, and instead could implement a system for 
both broadcasts and prerecorded materials. In the case of 
copying from one tape to another, such a system could not only 
provide the heroin mentioned library functions of the present 
invention, it could also be used to aid in copy protection, serial 
copy management, and a pny-per-view royalty collection system. 
Such a system could be implemented by way of a 
telecommunication function incorporated in the device, shown as 
block 1808 of Fig. IS, or an electronic ra^ which records user 
activity of a tape or the like. A royally fee, etc., could 
automatics) My be registered to the machine either by 
telecommunication or registry with the tag, allow in i> new viewer 
options to be provided as compared with present VCR's. For 
example, an encrypted tape or other source material (so that 
special playback equipment need be used, and a usage 
registered), used with this device, could be decrypted by a 
decryption key available by Telecommunication with a 
communication center, remote from the user, in a decryption unit, 
shown schematically as the decrypt unit 1 806a of Fig. 1 8. 
During acquisition of the key, a VCR device of an embodiment 
of the present invention would indicate its identity, and an 
account is charged a fee for such use. Such a system could also 
be used for controlled access software, for example for a 
computer, wherein a remote account is charged for use of the 

software The present invention is advantageous in this 

application because it provides an advanced user interface for 
creating a program, and it assists the user in selecting from Un- 
available programs, without havin» presented the user with a 
detailed description of the programs, i.e., the user may select the 
choice based on characteristics rather than literal description.... 
The user may make a vie win;; decision based on the 
recommendation of the interface system, or may review the 

..!-LS^'?i!£Q Jpi 1 ^.^?.!! L J? V:. f c or descr ip t i o n o f th e pro» ram , 


2106. 
2118. 
2410 


90:23-25 
l >l;1-25 
92: 1 -22 

i 
I 


In order to retrieve an entry, the user interacts with the same 
interlace Dial is used for programming the recorder functions, 
iiuvy^\ ^| , uovr ivvi^ ui i it i cm menu scicciiuiib, wn jen guiuc 
him to the available selections. This function, instead of Ibcusin;; 
mainly on the particular user's history in order ro predict a 
selection, would analyse the entire library, regardless of which 
user instituted the recording. 


2408, 
241 1. 


184:3-9 
66:19-20 


transmitting said 
retrieved one of said 


Another object of the present invention provides a system for 
presenting a program to a viewer, comprising... 


2408, 
2405 
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SPEC. 
PngeiLinc 


target object and set oi" 
target object 
characteristics to snicl 
user terminal for 
display the icon to said 
user. 

i 


means for receiving the program material from said source;.,, 
means for presenting the program material to the viewer, if said 
correlation index indicates a probable high correlation between 
said characterization of the program material and said viewer 
preference. 

The present invention is advantageous in this application because 
it provides an advanced user interface for creating a program* and 
it assists the user in selecting from the available programs, 
without having presented the user with a detailed description of 
the programs, i.e.. the user may select the choice based on 
characteristics rather than literal description. 




67:1-4 
92:10-16 


said step of 
automatically 
generating comprising: 
autonraiically updating 
said user target profile 
interest summary for 
said user as a function 
of said target objects 
and sets of target 
object characteristics 
retrieved by said user. 


........... — 




In Ihe case of a single user or group of users, the interface could 
maintain u history of feature usage for each user, as in the past 
user history block 2107, and provide a lower user interface level 
for those features which ore rarely used, and therefore less 
familiar to the user, through the current user level output 2 J0I. 

Each program entry of the user is submitted to the user history 
database and preferences module 2406, which may also receive 
cxplicir preference information, input by the user through the 
input device 2401 . 


2116, 
"2208, 
1707 


107: 14-19 

162:25 

163:1-3 

i 










^0, The method of 
claim 4<X, wherein said 
automatically 
general i iti; step 
! comprises: 








creating a customer 
profile, said customer 
1 profile indicating the 
respective customer's 
preferences for data; 


Each program entry of the user is submitted to the user history 
database and preferences module 2406, which may also receive 
explicit preference information, input by the user through the 
input device 240 1 . 


1703, 
2106, 
21 16. 
2308 


162:25 
163:1-3 


monitoring n history of In the case of a single user or group of users, the interface could 
' data objects accessed maintain a history of Icon ire usage for each user, as in the pnsr 

by the customer; and user history block 2 107. and provide a lower user interface level 
. for those features which are rarely used, and therefore less 
. familiar to the user, through the current user level output 2101. 


2107, 
2406 


107:14-19 
■'76*2-3 


! automatically updating 
! the customer profile in 
■ accordance with the 
: conleni profiles 

accessed by the 
! customer to 

aulomalically update 

tho customer profile to 

represent the 

c u si oi n er's p re fere n ces. 


When die programming is completed, the interface must then 
update its user database... 


2107, 






1 505 


02:3-6 


.•S !. The method of 


This presently described system differs from normal pay-per- 
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SPCC 
Page: Line 


c In i m 47, wherein said 
method is lor 
scheduling Customer 
access to darn from a 
plumliiy of' data 

SOLIIt.CS, 


view techniques because it allows, in certain instances, the user 
to schedule the viewing. 

The prospective event discussed above refers to a scheduled 
event, which is likely to occur in the future. The characterization 
unit also has a local database 2413 lor storing schedule 
information and the like. 




1(33: 17-20™ 


further comprising the 
step of creating conrenr 

profiles for eueh data 
source of said data, 
said contour profiles 
indicating the decree 
of content of said 
predetermined 
characteristics in data 
from each data source; 


Another object of the present invention provides a system for 

presenting a program to a viewer, comprising: 

a source of program material; 

means for deter in in ing a viewer preference; 

menus for receiving the program material from said source; 

means for characterizing the program material based on its 

content; 

means for correlating said characterized content of the 
program material with said determined viewer preference to 
produce u correlation index; and 

means for presenting the program material to the viewer, if said 
eon-elation index indicates a probable high correlation between 
said characterization of the program material and said viewer 
preference. 


1909, 

1-ig. 

22, 

2407 


66:15-25 
67: N4 


wherein: 




17027 
1703 




— . ■■; " ■ — 1 

Nil id customer profile 

creating step 

comprises dealing at 

least one customer 

profile lor each 

eligible recipient of 

said da Ui, said 

customer profile 

mdieaiiiv: the 

cum owe r's pre lerenees 

for dala having 

predetermined 

characteristics; 


In the cttsc of a single user or group of users, the interface could 
iiuiinlaiii a history of feature usage for each user, ns in the past 
user history block 2 107, and provide a lower user interface level 
for those features which are rarely used, and therefore less 
familiar to the user, through ihe cnrreni user level output 210) . 


107:14-19 


said monitoring step 
comprises monitoring 
which dala sources are 
actually accessed by 
each recipient; and 


Each program entry of the user is submitted to the user history 
database and preferences module 2406, which may also receive 
explicit preference in formation, input by the user ihrough the 
input device 240 1. 


1707. 
2107 

figs. 
2 \ 22 


162:25 
1 63: 1 -3 

i 
l 

i 

167:2-3 
165:14-19 


said updating step 
comprises updating, 
without input from 
each customer, each 
customer profile in 
accordance with the 
eo men i prolllo of the 
data sources actually 
i accessed by thai 
customer to 
automatically update 
each customer's actual 
preferences for said 
predetermined 


When the programming is completed, the interface must then 
update its user database.,. 

The interface then accesses the memory for a protlle of the past 
use of the machine by the user, which may include the entire 
prior history, relevant abstracts of the history, or derived user 
preferences, as shown in the persona Ii7ed startup based on user 
profile step 1 702, which information is also stored and used in 
the past user history determining element 2 107. 
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characteristics. 



52, The method of 
claim 47, wherein said 
met hod is for 
se h ed 1 1 1 i ng c usl o in e r 
access lo video 
programs. 



SPECIFICATION SUPPORT 



The present invention is advantageous in this application because 
it provides an advanced user interface tor creating a program, and 
it assists the user in selecting from the available programs, 
without having presented the user with a detailed description of 
the programs, i.e., the user may select the choice based on 
characteristics rather than literal description. 



further comprising the 
Step of creating content 
profiles for each video 
program rtvu liable lor 
viewing, said concent 
pro III es indieu Liny the 
decree of content of 
said predetermined 
characteristics in each 
video program; 



wherein: 



said customer profile 
creating step 
comprises creating at 
least one customer 
profile for cadi 
customer of said video 
programs, said 
customer profile 
indicating the 
customer's preferences 
f o r p r ed e t e r i m i a e d 
charncrerist ies of the 
video programs; 



said motiiioring step 
comprises monitoring 
which video programs 
arc actually viewed by 
each customer: and 



The present invention incorporates an intelligent program 
recognition and characterization system, making use of any 
of the available cues, which allows an intelligent 
determination of tlic true nature of the broadcast and 
therefore is able to make a determination of whether 
parameters should be deemed met even with an inexact 
match to the specified parameters. 

means for characterizing die program material based on its 
content; 

means for correlating said characterized content of the program 
material with said determined viewer preference to produce a 
correlation index; 



FIGS 



spec. 

Pa^c: Line 



1505 



92:10-16 



1909. 

2206, 
230<l, 
2407, 
2505, 
2507 



In the case of a single user or group of users, the interface cotdd 
maintain a history of feature usage for each user, as in the past 
user history block 2 107, and provide a lower user interface level 
for those features which are rarely used, and therefore Jess 
familiar to the user, through the current user level output 2101. 

The controller 18fJ6 of Fig. 18 thereafter uses n stored profile of 
the identified user in controlling the interaction with the user, as 
shown in block 1702 of fig, 17. from information stored in the 
database I §07 of Fig. 18 of the present invention. 



... 



1702 



1 1 is a still further object of the present invention to provide a 
system, further comprising means for storing a 
characterization of the program material, further comprising 
feedback means for inputting a feedback signal from the viewer 
indicating a degree of agreement with said presented stored 
program material, wherein said feedback signal and said stored 
characterization are used by said viewer preference determining 
means to determine a new viewer preference. 

In the case of encrypted program source material, it is 
particularly advantageous if the characterization of the program 
occurs without charging the account of the user for such 
characterization, and only charging the account if the program is 
viewed by the user. The user may make a viewing decision 
based on the recommendation of the interface system, or may 
review the decision based on -the title or description of the 
program. 



1707, 
2107 



53:21-25 
54; 1-2 
66:21*25 



I07;M-I9 
88:23-25 
89: L -2 



68:21-25 
69:1-3 
92:16-22 
199: 19^22 
165:14-19 
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CLAIM 



said updating step 
comprises updating, 
wit huu t input from 
each customer, each 
customer profile in 
accordance with the 
content profiles ofiho 

1 video programs 

j actually viewed by that 

j customer to 

I iiuloinaiieiilly update 

| each customer's ctciual 

j preferences Cor snicl 

j predetermined 

! characteristics. 



53. The met hod of 
claim 52. comprising 
the further steps of 
receiving customer 
identity information 
and determining from 
so id customer identity 
information which 
customer profile to 
update in said updating 
slep. 



SPRC1FICATI0N SUPPORT 



However, because the present control 2402 is intelligent and has 
pattern recognition capability, in addition 10 full data 
integration from all available data sources, ir may exec u re 
advanced control functions. 

The interface then accesses the memory for u profile of the past 
use of the machine by the user, which may include I he entire 
prior history, relevant abstracts of the history, or derived user 
preferences, as shown in die personalized startup based on user 
profile step 1702, which information is also stored and used in 
the past user history determini n g elem e nt 2 1 07 . 
In the case of u single user or group of users* the interface could 
maintain a history of feature usage for each user, as in the past 
user history block 2 107, and provide a lower user interface level 
for those features which arc rarely used, and therefore less 
familiar to the user, through the current user level output 2101. 

Raeh program entry of the user is submitted to the user history 
database and preferences module 2406. which may also receive 
explicit preference information, input by the user through the 
input device 240 1 . 



ICS 



SPliC. 
PflfZe:Line 



2 1. 22 



In the case of a single user or group of users, the interface could 
maintain a history of feature usage for each user, n.s in the past 
user history block 2107, and provide a lower user interlace level 
for those features which are rarely used, and therefore less 
familiar to the user, through the current user level output 2101. 

The system next must determine what function the user wishes to 
perform. In this regard, if more than one user has access to the 
system, the user identifies himself to the interface, in a user 
identification step 1701 or an analogous action, which may be a 
coded entry, or a selection from the menu. If the interface has 
voice recognition capability, then the user may be recognized by 
his voice pattern, or merely by staring his name. The interface 
then accesses the memory for a profile of the past use of the 
machine by the user, which may include the entire prior history, 
relevant abstracts of the history, or derived user preferences, as 
shown in the personalized startup based on user profile step 1702. ! 
which information is also stored and used in the past user history 
determining element 2 107. These choices differ in the amount of 
storage necessary in order to retain the desired information, 
Thus, as shown in Fig. 17, the user identifies himself to the 
controller in block 1701. The controller 1806 of Pig. I & 
thereafter uses a stored profile of the identified user in controlling 
the interaction with the user, as shown in block 1702 of Ft**. 17, 
from information stored in the database 1807 of Fig. IS of the 
present invention, A further example of the use of the advanced 
in i el litfci u features of the present, inventio n wo uld be if the user 



107: 
162 

163: 



14-19 
25 



1701 



M7:M-]<> 

165:7-21 

38:21-25 

170:1-25 

171:1-9 



30 



Receivedfrom<914 949 3416 > at 8/6/03 2:41:07 PM [Eastern Daylight Time] 



Rug 06 03 01:54p 



Milde 8. Hoffberg, LLP 



(914J 949-3416 



p. 35 



APPLICATION 
CLAIM 



SPECIFICATION SUPPORT 



54, The method of 
claim 47, wherein said 
method is lor 
scheduling customer 
access to data from a 
plurality of data 
sources, wherein: 



said customer profile 
creuiirig step 
comprises creating a 
customer profile for 
each customer of said 
plurality of data 
sources., said customer 
profile indicating said 
c usto in ef s pre ferences 
for predetermined 
characteristics of the 
data sources: 



wished to record, e.g., "live" musical pe if o nuances. These occur 
On many "talk" shows, such as Tonight Show with Johnny 
Carson" (NBC* 1 1:30 p.m. to 12:30 p.m.. weeknights). "Saturday 
Night Live" (NBC I 1:30 p,m, to 1:00 a.m. Saturday: . Sunday), 
and other shows such as the "Grammy Awards". The interface, if 
requested ro record such performances would seek to determine 
their occurrence, by. e.g., analyzing a broadcast schedule. by\ 
e.g., interacting with the on-line database 24 1 I, and the local 
database 24 1 3. When the interface determines with high 
probability that a broadcast will occur, tt then monitors the 
chaimel(s) at the indicated time(s). through the plurality of tuners 
2502. In the case of pay-per-view systems and the like, which 
incorporate encrypted signals, an encryption/decryption unit 2509 
is provided. This unit also allows encryption of material. During 
the monitoring, the interlace system acquires the audio and video 
information being broadcast, through the signal receiver 24 08. 
and correlates this information with a known profile of a "live 
musical performance", in the preference and event correlator 
2412. This must be distinguished from music as a port, of, e.g., a 
soundtrack, as well as "musicals" which are pari of movies and 
recorded operas, if these arc not desired. further, music videos 
may also be undesirable. When the correlation is high between 
the broadcast and n reference profile of a "Jive musical 
performance", the system selects the broadcast for retention. In 
this case, the information in the intermediate storage 2503 is 
transferred to the plant 2507. which includes a permanent storage 
device 2508. The intermediate storage 2503 medium is used to 
record a "buffer" segment, so that none of the broadcast is lost 
while the system delcrmincs the nature of the broadcast. This, of 
course, allows an extended period for the determination of the 
type of broadcast, so that, white real -time recognition is 
preferred, it is not absolutely necessary in order to gain the 
advantages of the present invention. 



1'IGS " SPEC. 



Thus, as shown in l ig. 17. The user identities himself to the 
controller in block 1701. The controller 1 806 of Pig. IS 
thereafter uses a stored profile of the identified user in controlling 
the interaction with the user, as shown in block 1702 of Fig. 17, 
from information stored in the database IS07 of Fi£. 18 of the 
present invention. 



In the case of a single user or group of users, the interface could 
maintain a history of feature usa&e for each user, as in the past 
user history block 2 107, nnd provide a lower user interface level 
for those features which are rarely used, and therefore less 
familiar to the user, through the current user level output 2101. 



_said moni toring step 



The intellig ence of the device of the pres ent inv ention is not 
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comprises monitoring 
which data sources nro 
actually accessed by 
each customer; and 



said updating step 
comprises updating 
each CListomcr profile 
10 a- Ilea the frequency 
of selection of the data 
sources by customers 
with customer profiles 
substantially similar to 
said each customer 
pro 111c. 



SPECIFICATION SUPPORT 



limited by rhe forego in examples: the user could also inpur 
' characteristics of the progrum material that are desired, and 
: character istics of thai proyxam material which is not desired. Che 
| device would then, over time, monitor various broadcast choices, 
| and determine which most closely match the criterion, and thus 
I be selected. 



56. The apparatus 
according to claim 55, 
for providing a user 
with access to selected 
ones of a plurality of 
laniet objects and sets 
of target object 
characteristics dun are 
accessible via an 
electronic storage 
media, where said 
users are connected via 
user terminals and data 
communication 
connections lo a target 
server system which 



It has been found that in the case of novice users, a greater 
number of simple instructions may be more quickly and 
easily input ml her thai) a potentially fewer number of a 
larger set of more complex instructions. It has further been 
found that, even if presented with n set of instructions which will 
allow a program 10 be entered with a fewer number of inputs, a 
novice user may choose to input the program using the simple 
instructions exclusively, thus employing an increased number of 
instructions and bein£ delayed by tin increased search time for 
thOsSe instructions thai arc used, from the larger set, 

One goal of the interface of the present invention is to minimize 
Tacquire. By Card's model, the execution time is the time, tj, for 
each of these operators] weighted by the frequency, nj, with 
which they occur, plus the total system response time, TR, to the 
steps performed by the user. ... 

Thus, if the user has only used the VCR to record, e.g., the NBC 
I 1 o'clock news, i.e., record all days from I 1:00 p.m. to 1 1:30 
p.m. on NBC. in the past, the most likely ciirrenr predicted choice 
would be the NBC I 1 o'clock news. 

The interlace of the present invention would study the initial 
behavior of the user to determine the expected user level of 
that user. 

The most frequently used choices preferably should be 
displayed, as the default setting. 

The system's lo^ic should reflect the users' expectations, offer 
visual clues and fcedbac k, and slay within human memory limits. 



Figure 24 shows a system for correlating a user's preferences 
with a prospective or real-time occurrence of an event. The input 
device 2401 , which is a remote control with a pointing device, 
such as a trackball* provides the user's input to the control 2402. 
The program is stored in a program memory 2403, after it is 
entered. The control 2'102 controls a plant 2404. which is a VCR. 
The control also controls an on-screen programming interface 
2405. through which the user interactively enters the program 
information. Each program entry of the user is submitted To The 
user history database and preferences module 2406. which may 
also receive explicit preference information, inpuL by the user 
Through the input device 2401. The prospective and real time 
event characterization unit 2<107 uses any and all information 
available in order to determine the character of a signal input, 
which is a video signal, from the signal receiver 24 08. A signal 
anal yzer 240*> provides a pr eliminary analysis and 
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l 



means for 
automatically 
generating at least one 
user large! profile 
interest summnry tor a 
user ai j user terminal, 
each of said user target 
pro 111 e interest 
summaries being 
i indicative of ones of 
I said target objects and 

I sets of target object 
I characteristics 
j accessed by said user: 
and 



characterization of the signal, which is input to the prospective 
and real time event characterisation unit 2407. The prospective 
and real time event characterization unit 2407 also interacts and 
receives an input from a telecommunication module 2410, which 
in turn interacts and receives information from an on-line 
database 24 1 1 . A user preference and event correlator 24 12 
produces on output relating to a relatedness of an event or 
prospective event and a user preference, In the event of a high 
correlation or relatedness, the control 2402 determines that the 
event or prospective event is a likely or most likely predicted 
action. The prospective event discussed above refers to a 
scheduled event, which is likely to occur in the full) re. The 
characterization unit also has a local database 24 1 3 for storing 
schedule information and the like. 

Thus, one embodiment of the device may incorporate u memory 
for storing a program, before being Irani 1 erred to a permanent 
storage facility, such as tape. Such a memory may include u hard 
disk drive, magnetic tape loop, a rewritable optical disk drive, or 
semiconductor memories, including such devices as wafer scale 
memory devices. This is shown diagrammatical ly as the 
inte rmediate storage 2210 of Fig. 22. 



Lach program entry of the user is submitted to the user history 
database and preferences module 2406, wl;ich may also receive 
explicit preference information, input by the user through the 
input device 2401. 



means for storing said 
a l: leas i one user target 
profile interest 
summary in a memory. 



57. The apparatus of 
claim 56. further 
comprising: 



The interface then accesses the memory for :i profile of the past 
use of the machine by the user, which may include the entire 
prior history, relevant abstracts of the history, or derived user 
preferences, as shown in the personalized startup based on user 
profile step 1702, which information is also stored and used in 
the past user history determining element 2 107. These choices 
differ in the amount of storage necessary in order to retain the 
desired information. 



means for enabling, 
said user ro access said 
plurality of target 
objects and sets of 
' tar ge: object 



Figure 24 shows a system for correlating a user's preferences 
with a prospective or real-time occurrence of an event. The input 
device 2401, which is a remote control with a pointing device, 
such as a trackball, provides the user's input to the control 2402. 
_Tl^prngrar n is stored in a program memor y 2403, after it is 
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characteristics stored 
on said electronic 
storage media via said 
user target profile 
interest summaries; 



said mean* for 
enabling access 

comprising 

means lor correlating 
said user tar get profile 



SPECIFICATION SUPPORT 



FIGS 



entered. The control 2-102 controls a plant 2404, which is a VCR. 
The control also controls an on-screen programming interface 
2105. through which lite user interactively enters the program 
information. Each program entry of the user is submitted to the 
user history database and preferences module 2406, which may 
also receive explicit preference information, input by die user 
through the input device 2401. The prospective and real time 
event characterization unit 2407 uses any and all information 
available in order to determine the character of a signal input, 
whieh is a video signal, from the signal receiver 2408. A signal 
analyzer 2409 provides a preliminary analysis and 
characterization of the signal, which is input to the prospective 
and real time event characterization unit 2407, The prospective 
and real time event characterization unit 2407 also internets and 
receives an inpul from a telecommunication module 24 10. whieh 
in turn interacts and receives information from an on-line 
database 24 1 1 . A user preference and event correinror 24 12 
produces an output relating to a relaledriess of an event or 
prospective event and a user preference. In the event of a high 
correlation or re I a ted n ess, the control 2402 determines that the 
event or prospective event Ls a likely or most likely predicted 
action. The prospective event discussed above refers to a 
sell ed tiled event, which is likely to occur in the future. The 
characterization unit also has a local database 24 1 j for storing 
schedule information and the tike. 

Thus, one embodiment of the device may incorporate a memory 
for storing a program, before being transferred to a. permanent 
storage facility, such as tape. Such a memory may include a hard 
disk drive, magnetic tape loop, a rewritable optical disk drive, or 
semiconductor memories, including such devices as wafer scute 
memory device*. This is .shown diagrnmmntically as The 
intermediate storage 2210 of Fig. 22. 

In the present invention, an area of the tape, preferable at the 
beginning of the tape or at multiple locations therein, is encoded 
to hold information relating to the contents of the tape. This 
encoding is shown in Fig. 19, which shows a data format for the 
information. This format htis an identifying header 1901. a 
unique tape identifier 1 902, an entry identifier 1903. a start time 
1 *>04. an end time 1905 and/or a duration 1906, a date code 1907, 
a channel code 1 90S, descriptive information 1909 of the 
described entry; which may include recording parameters and 
actual recorded locations on the tape, as well as a title or episode 
identifying information, which may be a fixed or variable length 
entry, optionally representative scenes 1910, which may be 
analog, digital, compressed, or related to rhe abstract 
characterizations of the scenes formed in the operation of the 
device. 



SPLC. 
Pas>e:Line 



t 



A user preference and event correlator 2412 produces an output 
relating to a relatedness of an eve nt or prospective p event and a 
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interest summaries, 
generated for said user, 
with target profiles 
generated for said 
plurality of turret 
. objects anil sets of 
target object 
characieristics in 
identify ones of said 
plurality of target 
objects and sets of 
large I object 
characteristics v^iorcd 
on said electronic 
si in age media I hat are 
likely io he of interest 
to said user; 


user preference. 






means for transmitting 
a list, that identifies at 
least one of so id 
identified ones of said 
plurality of target 
objects and sets of 
Lngel object 
characteristics, to said 
user; and 


Thus, il the user has only used the VCR to record, e.g., the NBC 
1 1 o'clock news, i.e., record all days from 1 1 :00 p.m. to 1 1:30 
p.m. on NBC, in the past, the most likely current predicted choice 
would be the NBC 1 I o'clock news. If the interface were io 
present a number of choices, having lower probability, then it 
would interpret the recording history to be "news" based on a 
database of broadcast information. Therefore, a prediction of 
lower probability would be ABC or CBS news at, e.g., 1 1 :00 
p.m.. and the NBC news at, e.g., 5:00 p.m. Thus, these three 
choices would be initially presented to the user, along with a 
menu selection to reject these predicted choices. 




165:22-25 
166:1-7 

1 66:7-25 
1 67:1*2 


means for providing 
access to a selected 
one of said plurality of 
target objects and sets 
of target object 
characteristics stored 
on s;ild electronic 
storage media in 
response to said user 

• selecting an item from 

j said list. 


In this case, rhe user would select the "reject" selection, and 
would be presented with a next predicted desired menu choice, 
Since the user history, in this case, does not provide For anoiher 
choice of high probability, the user would be prompted to 
explicitly choose the program sequence by day, time, channel, 
and duration. 1 he user would then enter the starting time for 
recording nccordinu to the methods described abov<r,, , , The user 
then selects one of the available choices, which would complete 
the programming sequence. 1 f no database of broadcasts is 
available, then the user must then explicitly define all parameters 
of the broadcast. 


Iml;S. 
L< 17 


said means for 
i providing access 
comprising; 








means for transmitting 
data, in response io 
said user adivating 
said user terminal to 
idcniify said selected 
item on said list* 
indicative of said 
user's selection of said 
selected item from said 
user terminal to said 

: mrget server via n one 

; of said data 


The present invention also allows encryption and decryption of 
material, much as the Vidcocipher series systems from General 
Instruments, and the fractal enciphering methods of EMC2 and 
Iterated Systems, Inc. The present invention, however, is not 
limited to broadcasts, and instead could implement a system for 
both broadcasts and prerecorded materials. In the case of 
copying from one tape to another, such a system could not only 
provide the herein mentioned library functions of ihe present 
invention, it could also be used to aid in copy protection, serial 
copy management, and a pay-per-view royalty collection system. 
Such a system could be implemented by way of a 
telecommunication function incorporated in the device, shown as 


2106, 
2 1 1 8, 
2'I10 
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communication 
connections: 

i 
i 

! 


block J SOS of Fi». 1 S, or an electronic tag which records user 
activity of a tape or the like. A royalty fee. etc., could 
automatically be registered to the machine either by 
lelccomnumicarion or registry with the tag, allowing new viewer 
options to be provided as compared with present VCR's. For 
example, an encrypted tape or other source material (so thai 
special playback equipment need be used, and a usage 
registered), used with this device, could be decrypted by n 
decryption key available by telecommunication with a 
communication center, remote from the user, in a decryption unit, 
shown schematically as the decrypt unit I306u of Fig. 18. 
During acquisition of the key, a VCR device of an embodiment 
of til e present invention would indicate its identity, and an 
account is charged a fee for such use. Such a system could also 
be used for controlled access software, for example for a 
computer, wherein a remote account is charged for use of the 
software.... The present invention is advantageous in this 
application because it provides an advanced user interface for 
creating a program, and it assists the user in selecting from the 
available programs* without having presented the user with a 
detailed description ol the programs, i.e., the user may select the 
Choice based on characteristics rather than literal description.... 
The user may make a viewing decision based on the 
recommendat ion of the interface system, or may review the 
decision based On the title Or description of the program. 


24 1 I. 
2413 


i 


menus lor retrieving, 
in response to receipt 
of said darn from said 
user terminal, a target 
object identified by 
snid selected item from 
said electronic storage 
media: and 


In order to retrieve an entry, the user interacts with the same 
interface thai is used for pro; y: immin^ the recorder functions, 
however, the user selects different mean selections, which guide 
him Lo the available selections. This function, instead of focusing 
mainly on the particular user's hisrory in order to predict a 
selection, would analyze the entire library, regardless of which 
user instituted the recording. 




me: ins for transmitting 
said retrieved target 
object to said user 
terminal lor display 
thereon to said user: 


Another object of the present invention provides a system for 

presenting a program to a viewer, comprising... 

means tor receiving the program material from said source;... 

means for presenting the program material to the viewer, if said 

correlation index indicates a probable high correlation between 

said characterization of the program material and said viewer 

preference. 

The present invention is advantageous in this application because 
it provides nn advanced user intotfnee for creating a program, and 
it assists the user in selecting irorn the available programs, 
without having presented the user with a detailed description of 
the programs, i.e,, the user may select the choice based on 
characteristics rather than literal description. 
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92: 10-16 


said means for 
automatically 
generating; comprising; 








means for 

a iitom ;u i c n 1 1 y u pd n r i ng 
said user target profile 
interest summnrv for 


In the case of a single user or group of users, the interface could 
maintain a history of feature usage for each user, as in the past 
user history block 2 107. and provide a lower user interface level 
for those features which are rarely used, and therefore less 
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said user as a function 
of said target objects 
and sots of target 
object characteristics 
retrieved by said user. 


familiar to the user, through the current user level output 2 1 0 L 

Each program entry of the user is submitted to the user history 
databa.se and preferences module 2406, which may also receive 
explicit preference information, input by the user through the 
input device 2401. 














5 L ). The system 
according to claim 58, 
Tor scheduling 
cti-sromer access ro 
data from a plurality of 
data suurccs. further 
compels in?;; 


This presently described system differs from normal pay-per- 
view techniques because it id lows, in certain instances, the user 
to schedule the viewing. 

The prospective event discussed above refers to a scheduled 
event, which is likely to occur in the future. The 
characterization unit also has n local (hmibasc 2413 for 
storing schedule in formation :uid the tike. 


1505 


92:3-6 
163:17-20 


content pro riles tor 
each darn source of 
said darn, said content 
profiles indicating the 
decree of content of 
.said predetermined 
characteristics in data 
Iron i each data source; 


Another object of the present invention provides a system for 

presenting u program to u viewer, comprising: 

a source of program material; 

means for determining a viewer preference: 

means tor receiving the program material from said source: 

means for characterizing the program material bused on its 

content; 

means for correlating said characterized content of the program 
material with said determined viewer preference to produce a 
correlation index; and 

means for presenting the program material to the viewer, if said 
correlation index indicates a probable high correlation between 
said characterization of the program material and said viewer 
preference. 


1090, 

Kig. 

22. 

2304. 

2407 


66:13-25 
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wherein: 






1 


nt least one customer 
profile lor each 
eligible recipient of 
said darn is provided, 
snid customer pro tile 
indicating the 
en si 0 m er's pre tore nces 
for data having 
prede term i ned 
characteristics; 


In the case of a single user or group of users, the interface could 
maintain a history of feature usage for each user, as in the past 
user history block 2 107, and provide a lower user interface level 
for those features which are rarely used, and therefore less 
familiar to the user, through the current user level output 2101. 


1702, 
!703 

17077" 
2107 


107:14-19 ; 


said monitoring moans 
monitors which data 
sources are actually 
accessed by each 
recipient; and 


Bach program entry of the user is submitted to the user history 
database and preferences module 2406, which may also receive 
explicit preference in formation, input by the user through the 
input device 2401. 


162:25 
163:1-3 


said upd acini', means 
updates, without input 
! from each c it stonier, 
■ each customer profile 
, in accordance with the 
content profiles of the 
data sources actually 
accessed bv rh:ir 


When the programming is completed, the interface must then 
update its user database... 

The interface then accesses the memory for a pro tile of the past 
use of the machine by the user, which may include the entire 
prior history, relevant abstracts of the history, or derived user 
preferences, as shown in the personalized startup based on user 
profile step 1702, which information is also stored and used in 
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the past user history determining element 2 107. 












^2: 10-16 


60. 1 he sysicm 
according to claim 58, 
Tor scliedul ing 
customer access to 
video programs 
received from a video 
head end, further 
comprising; 


The present invention is advantageous in this application because 
it provides an advanced user interface for Creating a program, and 
it assists the user in selecting from the available programs, 
without having presented the user with a detailed description of 
the programs, i.e., the user may select the choice based on 
characteristics rather than literal description. 




content profiles for 
each video program 
available for viewing, 
said content profiles 
indicating the decree 
of eonlcnt ol said 
predelennincd 
charncterisiics in each 
video program; 


The present invention incorporates an intelligent program 
recognition and characterization system, making use of any of the 
available cues, which allows an intelligent determination of the 
true nature of the broadcast and therefore is able to make a 
determination of whether parameters should be deemed met even 
with an inexact match to The specified parameters. 

means for characterizing the program material based on its 
content: 

means for correlat ing said characterized content of the program 
material with said determined viewer preference to produce a 
correlation index; 


1909, 
2206, 
2304. 
2407, 
2505. 
2507 


53:21-25 
54:1-2 
66:2 1-25 


wherein; j 


1 702 


107: 14-] 9 

88:23-25 

89:1-2 


at least one customer 
profile for each 
customer uf said video 
programs is provided. 

id customer profile 
indicating the 
customcr's preferences 
for predetemimed 
. characteristics of the 
video programs: 


In the case of a single user or group of usees, the interface could 
maintain a history of feature usa^e for each user, as in the past 
user history block 2 1 07. and provide a lower user interface level 
for those features which are rarely used, and Therefore less 
familiar to the user, through the current user level output 2 101. 

The controller 1 S06 of Fig. 1 8 thereafter uses a stored prollle of 
the identified user in controlling the interaction with the user, as 
shown in block 1702 of Fig. 17, from information stored in the 
database 1807 of Fig. 18 of the present invention. 


i said means for 
| monitoring monitors 
which video programs 
are actually viewed by 
each customer; and 


It is a still further object of the present invention lo provide a 
system, further comprising means for storing a characterization 
of the program material, further comprising feedback means for 
inputting n feedback signal from the viewer indicating n decree 
of agreement with said presented stored program material, 
wherein said feedback signal and said stored characterization are 
used by said viewer preference determining means to determine a 
new viewer preference. 

lit the case of encrypted program source material, it is 
particularly advantageous if the characterization of the program 
occurs without charging the account of the user for such 
characterisation, and only charging the account if the program is 
viewed by the user. The user may make a viewing decision 
, based on the recommendation of the interface system, or may 


1707. 
2107 


68:21-25 
69:1-3 
t)2:!6-22 
199:19-22 
165: 14-19 
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review the decision based on the title or description of the 
program. 

However, because the prcsenL control 2402 is intelligent and has 
pattern recognition capability, in addition to full data integration 
from alt available data sources, it may execute advanced control 
functions. 

The interface then accesses the memory far u profile of the past 
use of the machine by the user, which may include the entire 
prior history, relevant abstracts of the history, or derived user 
preferences* as shown in the personalized startup bused on user 
profile step 1702, which information is also stored and used in 
the past user history determining element 2 107. 


iTgl" 

2 L 22 


i07:M-10 

162:25 

163:1-3 


id mains for 
upchuiiv; uptimes, 
wirhoui inpiM from 
each customer, each 
customer profile in 
accordance wiih the 
moment profiles of the 
video programs 

ncruiillv viewed by that 

** 

customer to 
automatically update 
each cuslomcr's actual 
preferences lor said 
| predetermined 
characteristics. 


h? the case of 'i single user or group of users, the interface could 
maintain a history of feature usa?;e for each user, as in the past 
user hisrory block 2107, and provide a lower user interface level 
for those features which are rarely used, and therefore less 
Familiar to the user, through the current user levd output 2 10 L 

Each program entry of the user is submitted to the user hisrory 
database and preferences module 2406, which may also receive 
explicit preference information, input by the user through the 
input device 240 1 . 










: G 1 . The system as in 
: claim (if), rtirrher 
comprising: 








• means for trnnsmitting 
said cuntcnl prolilcs 10 
each customer alonti 
with electronic 
program guide data for 
upcoming television 
viewing periods. 


"Die prospective and real rime event ehuraeterizalion unit 2 '107 
also internets and receives an input from a telecommunication 
module 2410, which in rum internets and receives information 
from an on-line database 241 1. 


241 1. 
2410 


163:9-12 










62. The system as in 
claim 60. further 
comprising means for 
inputting customer 
identity information 
a nd for determining 
from said customer 
identity in forma I ion 
which customer prolllo 
to update with said 
updating means. 


In die ease of a single user or group of users, the interface could 
maintain a history of feature usage tor each user, as in the pust 
user hisLory block 2 107* and provide a lower user interface level 
for those features which arc rarely used, and therefore less 
familiar to the user, through the current user level output 2101. 

The system next must determine what function the user wishes to 
perform. In this regard* if more than one user has access to the 
; system, the user identifies himself to the interface, in a user 
identification step 1701 or an analogous action, which may be a 
coded entry, or a selection from the menu, ff the interface has 
voice recoijnilion capability, then the user may be recognized by 


1701. 
1707 


107:14-19 

165:7-21 

88:21-25 

170:1-25 

171:1-9 
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his voice pattern, or merely by stating his name. The interface 
then accesses the memory for a profile of the past use of the 
machine by the user, which may include me entire prior history, 
releviint abstracts of the history, or derived user preferences, as 
shown in the personalised startup based on user profile step 1702, 
which information is also stored and used in the past user history 
determining clement 2 107. These choices diilcr in the union nr of 
storage necessary in order to retain the desired information. 
Thus, as shown in Fig. 17, the user identifies himself u> the 
controller in block 1701. The controller lS06ofl r ig. 18 
thereafter uses a stored profile of the identified user in controlling 
the interaction with me user, as shown in block 1702 of Fig. 17, 
from information stored in the database 1807 of Fig. 18 of the 
present invention. A further example of the use of the advanced 
intelligent features of the present invention would be if the user 
wished u> record, e.g.. "live" musical performances. These occur 
on many "talk" shows, such as "Tonight Show with Johnny 
Carson" (NBC, I I :30 p.m. to 12:30 p.m.. wtieknights), "Snturdny 
Night Live" (NBC 1 1:30 p.m. 10 1:00 a.m. Saturday! Sunday), 
and orher shows such as The "Grammy Awards". The interface, if 
requested to record such performances would seek to determine 
their occurrence, by. e.g., analyzing a broadcast schedule, by, 
e.g.. interacting with the on-line database 24 1 I . and the local j 
database 2413. When the interface determines: with high 1 
probability that u broadcast will occur, it then monitors the i 
chaiinelts) at I he indicated rime(s), through the plurality of tuners 
2,^02. In the case of pay -per- vie w systems and the like, which 
incorporate encrypted signals, an encryption/decryption unit 2S0° 
is provided, This unit nlso allows encryption of material. During 
the monitoring, the interface system acquires the audio and video 
information beins broadcast, through the signal receiver 2408, 
and correlates this information with a known profile of a "live 
musical performance", in the preference and event correlator 
24 12. This must be distinguished from music as a part of. e.g., a 
soundtrack, as well as "musicals" which arc part of movies and 
recorded operas, if these are not desired. Further, music videos 
may also be undesirable. When the correlation is high between 
the broadcast and a reference profile of a "live musical 
performance", the system selects the broadcast for retention. In 
this case, the information in the intermediate storage 2503 is 
transferred to the plant 2507. which includes a permanent storage 
device 2508. The intermediate storage 2503 medium is used to 
record a "buffer" segment, so that none of the broadcast is lost 
while the system determines the nature of the broadcast. This, of 
course, allows an extended period for the determination of the 
type of broadcast, so that, while real-time recognition is . 
preferred, it is not absolutely necessary in order to gain the ! 
advflntag.e s of the present invention. • 



63. The sysiem 
according to claim 60, 
for scheduling 
customer access to 
data pro vided by a 



This presently described system differs from normal pay-per- 
view techniques because it allows, in certain instances, the user 
! to schedule the viewing. 



1505 



02:3-6 
163:17-20 



The prospective event d i sc 1 1 sscd a bove refers to a scheduled 
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plurality of data 
sources, further 

>mni"i^in ' 


event, which is likely to occur in the future. The characterization 
unit also has a locnf database 24 13 for storing schedule 

infonn.itioo find I In* likr 

\l I IVJl 1 1 till ILN 1 tlllU IHVl. 






means for creating a 
Customer profile for 
each customer of said 
plurality of data 
.sources, s.iirl customer 
profile indicating snicl 

<.UMVI'UI > piivlvl vf 11 

for predetermined 
characteristics of the 
data sources: 


In the case of a single user or group of users, the interface could 
maintain a history of feature usage for each user, as in the past 
user history block 2 1 07, and provide a lower user interface level 
for those lealurcs which are rarely used, and therefore less 
familiar io the user, through the current user level output 2101. 


2502, 

1909, 

Pig. 

22. 

2304, 

2407 


107:14-19 


said monitoring means 
monitors which data 
sources are actually 
accessed by each 
customer: and 


The intelligence of the device of the present invention is not 
limited by the foregoing examples; the user could also input 
characteristics of the program material that are desired, and 
characteristics ofihai program material which is not desired. The 
device would then, overtime, monitor various broadcast choices, 
and determine which most closely match the criterion, and thus 
be selected. 


1707, 
2107 


107:20-25 
103:1 


said updating means 
updates each customer 
profile to reflect the 
frequency of selection 
of the data sources by 
customers with 
customer profiles 
substantially similar to 
said each customer 
profile. 


It has been found that in the case of novice users, a greater 
number of simple instructions may be more quickly and easily 
input rather than a potentially fewer number of a larger set of 
more complex instructions. It has further been found that, even if 
presented with a set of instructions which will allow a program to 
be entered with a fewer number of inputs, u novice user may 
choose to input the program using the simple instructions 
exclusively, thus employing an increased number of instructions 
and bein£ delayed by an increased search time for those 
instructions that are used, from the larger sel. 

One goal of the interface of the present invention is to minimize 
Tncquire. By Card's model, the execution time is the time, tj, for 
each of these operators j weighted by the frequency, n j. with 
which They occur, plus the total system response time. TR. to the 
steps performed by the user.... 

Thus, if the user has only used the VCR to record, e.^.. the NQC 
1 1 o'clock news, i.e., record all days from 1 1:00 p.m. to 1 1:30 
p.m. on NRC, in the past, the most likely current predicted choice 

. uAu 1 1 ] L, i * L, i \T Df 1 1 1 iV T /» L u»l- w+r ****** 

would De ine .nl>\_ i i ocIock news. 

The interlace of the present invention would study the initial 
behavior of the user to determine the expected user level of that 
user. 

The most frequently used choices preferably should be displayed, 
as the default setting, 

The system's lo$ic should reflect the users' expectations, offer 
visual clues and feedback, and stay within human memory limits. 


Figs. 
2 1 22 


89:2-1 1 

132:20-25 

165:22-25 

106:14-16 

85:1-2 

95:2-4 








64. The system 
according to claim 58. 


It is also noted chat the interface of the present invention need not 1 1 505 
be limited to audio-visual and multimedia applications, as similar | 


120: Id- 17 
200:20-2? 
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be hi» a multimedia 
' terminal lor receiving 
: data from a plural it)' of 

data sources, further 

comprising: 


issues arise in various program rouble controller environments. 

However, by incorporating the advanced interface and pattern 
recognition function of the present invention, as well as its nbility 

. to interface with a variety of unrelated sensors, the present 
device, the present control may be more easily programmed to 
execute control and alarm 1 unctions, may provide a centralized 
source of patient information, including storage and retrieval, if 
diverse sources of such in format ion are linked, and may execute 

jadyimced, ndnprive control functions. 




i 20I:U3 


menus tor storing, nr 
least one customer 
profile indicating a 
customer's preferences 

| for d:it;a having 

j predetermined 
characteristics: 


Each program entry of the user is* submitted to the user history 
database and preferences module 2406. which may also receive 
explicit preference information, input by the user through the 
input device 2401. 


1702, 
1703 


162:25 
163: N3 


means lor storing 
content profiles for 
each data source of 
*nid data, said content 
profiles indicating the 
decree of content of 
said predetermined 
characteristics in data 
from each data source: 


Another object of the present invention provides a system for 

presenting a program to a viewer, comprising: 

a source of program material; 

means for determining a viewer preference; 

means for receiving the program marerial from said source: 

means for chiimcterizini;. (he program marerial based on irs 

content: 

means for correlating said characterized content of the program 
material with said determined viewer preference ro produce a 
correlation index; and 

means for presenting the program materia! to the viewer, if said 
correlation index indicates a probable high correlation between 
said characterization of the program material and said viewer 
preference. 


1909, 

Fig. 

22, 

2304. 

2407 


66:15-25 
(J7:N4 


means for inputting 
recipient identity 
information: 


The system next must determine what function the user wishes to 
perform. In this regard, if more than one user has access to the 
system, the user identities himself to the interface, in a user 
identification step 1701 or an analogous action, which may be a 
coded entry, or a selection from the menu. If the interface has 
voice recognition capability, then the user may be recognized by 
his voice pattern, or merely by stating his name. The interface 
then accesses the memory for n profile ofrhe past use of the 
machine by the user, which may include the entire prior history, 
relevant abstracts of the history, or derived user preferences, as 
shown in the personalized startup based on user profile step 1702, 
which information is also stored and used in the past user history 
determining element 2 107, These choices dilfer in the amount ol 
Stontge necessary in order to retain the desired information. 

Thus* as shown in Fig. 1 7, the user identifies himself to the 
controller in block 1701. The controller 1 806 of Th;. IS 
thereafter uses a stored profile ol the identified user in controlling 
the interaction with the user, ns shown in block 1702 of Fig. 17. 
from information stored in the database 1807 of Fig. 18 of the 
present invention, 

A further example of the use of the advanced intelligent features 


1701 


165:7-21 
8S:2I-25 
170:1-25 
171:1-9 
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of the present invention would be if the user wished ro record, 
e.g.. "live" musical performances. These occur on many "talk" 
shows, such as "Tonight Show with Johnny Carson" (NBC. 1 1:30 
p.m. to 12:30 p.m., week nights), "Saturday Night Live" (NBC 
I 1 :30 p.m. lo 1 :00 a.m. Saturday-Sunday), and other shows such 
as the "Grammy Awards"* The interface, if requested to record 
such performances would seek to determine dicir occurrence, by, 
e.g., analyzing a broadcast schedule, by, e.g., interacting with the 
on-line database 24 1 L and the local database 2413, When the 
interlace determines with high probability that a broadcast will 
occur, il then monitors the channcl(s) ul the indicated time(s), 
through the plurality of tuners 2502. In the case of pay-per-view 
systems and the like, which incorporate encrypted signals, on 
encryption/ decrypt ion unit 2509 is provided. This unit also 
allows encryption of material. During the monitoring, the 
interface system acquires the audio mid video information 
being broadcast, through the signal receiver 2408, and 
correlates this information with a known profile of n "live 
musical performance", in the preference and event correlator 
2412. This must be distinguished from music as a part of, e.g., a 
soundtrack, as well as "musicals" which are part of movies and 
recorded operas, if these are not desired, further; music videos 
may also be undesirable. When the correlation is high between 
the broadcast and a reference profile of a "live musical 
i performance", the system selects the broadcast for retention. In 
, this case, the information in the intermediate storage 2503 is 
! transferred to the plant 2507, which includes a permanent storage 
| device 250 b\ The intermediate storage 2503 medium is used to 
| record a ''buffer" segment, so that none of the broadcast is lost 
I while die system determines the nature of the broadcast. This* of 
! course, allows an extended period for che determination of the 

type of broadens! , SO that, white real-time recognition is 
: preferred, il is not absolutely necessary in order to gain the 
advantages of the present inventio n. 



means for select in i* 
different customer 
profiles which 
correspond to said 
recipient identity 
information in 
accordance with rhe 
time of day and day of 
the week; 



processing means for 
relating said selected 



When a user regularly applies the VCR. device, for example, to 
record a given television show which appears weekly on a given 
television channel, at o given rime, on a given channel, such an 
action could be immediately presented to the user as a first 
option, without forcing him to explicitly program the entire 
sequence, 

Kurlher, if an entire television programming guide for a week or 
month is available as u database, the interface could actively 
determine whether the desired show is preempted, a repeat, 
changed in rime or programming slot, etc. Thus, the interface 
could present information to the user, of which he might not be 
aware, and predict an action based on that information. Such a 
device could, if set in a mode of operation that allows such, 
automatically execute a sequence of instructions based on a 
predicted course of action. Thus, if a user is to be absent for a 
period, he could sec the machine to automatically record a show, 
even if the reco rding paru meters are not known at ch e time. 



The system next must determine what function the user wishes to 
perform . Tn this regard, if more than one ttser h ns access t o the 



spec 

Puuc:Line 



1702 



1 60: 1 -6 
160:7-1" 
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system, the user identifies himself to Ihc interlace, in a user 
identification step 1701 or an analogous action, which may be a 
coded entry, or a selection from the menu. If the interface has 
voice recognition capability, then Ihc user may be recognized by 
his voice pattern, or merely by stating his name. The interface 
then accesses the memory for n profile of the past use of the 
machine by the user, which may include the entire prior history, 
relevant abstracts of the history, or derived user preferences, as 
shown in the personalized .startup based on user profile step 1702, 
which information is also stored and used in the past user history 
determining element 2 107. These choices differ in the amount of 
storage necessary in order to retain the desired information. 

Thus, as shown in Fig, 1 7, the user identities himself to the 
controller in block 1701. The controller 1X06 of Fig. 18 
thereafter uses a stored profile of the identified user in controlling 
the interaction with the user, as shown in block 1702 of Fig. 17, 
from information stored in the daiabase 1807 of Fig. 18 of the 
present invention. 

A further example of die use of the advanced intelligent features 
of the present invention would be if the user wished to record, 
e.g.. "live" musical performances. These occur on many "talk" 
shows, such as "Tonight Show with Johnny Carson" (NBC, 1 1 :30 
p.m. to 12:30 p.m., weeknhihrs). "Saturday Ni»ht Live" (Ni.iC 
1 1 :.>0 p.m. lo 1 :00 a.m. Saturday-Sunday), and other shows such 
as (he "Grammy Awards". The interface, if requested to record 
such performances would seek to determine their occurrence, by, 
e.g., analyzing a broadcast schedule, by, e.g., interacting with il ic- 
on-lino database 24 1 1, and the local database 24! j. When the 
interface determines with high probability that a broadcast will 
occur, it then monitors the ehannel(s) at the indicated time(s). 
through the plurality of tuners 2502, In the case of pay-per-view 
system? and the like, which incorporate encrypted signals, an 
encryption/decryption unit 2509 is provided. This unit also 
allows encryption of material. During the monitoring, die 
interface system acquires the audio and video information being 
broadcast, through the signal receiver 2408, and correlates this 
information with a known profile of a "live musical 
performance", in the preference and event correlator 24 12. This 
must be distinguished from music as a part of, e.g., a soundtrack, 
as well as M musicals" which are part of movies and recorded 
operas, if these are not desired, further, music videos may also 

1 ~ .1 - . * ... L 1 i U L iL 1 • "I'll* <• ■ 

be undesirable, when the correlation is high between the 
broadcast and a reference profile of a "live musical performance 0 , 
[he system selects the broadcast for retention. In this case, the 
information in the intermediate storage 2503 is transferred to the 
plant 2507. which includes u permanent storage device 250$, 
The intermediate storage 250:> medium is used to record a 
"buffer" segment, so that none of the broadcnsi is lost while ihc 
system determines the nature of ihc broadcast. This, of course, 
allows an extended period for rhc determination of the type of 
broadcast, so that, while real-time recognition is preferred, it is 
not absolutely necessary in order to gain the advantages of Ihc 


24, 
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piotm iiivvniiun. 

l-urther, if an entire television programming guide for a week or 
monrh is available as u database, the interfiles could actively 
determine whether the desired show is preempted, a repeat, 
changed in time or programming slot. etc. Thus, the interface 
coLltd present information to the user, of which he might nor be 
aware, and predict an action based on that information. Such a 
device could, if set in a mode of operation that allows such, 
automatically execute a sequence of insirueiions based on a 
predicted course of action. 






;i display yuide for 
presenting said subset 
of data it) said 
customer lor selection. 

i 


Further, if an entire television programming guide for a week or 
month is available as a database, the interface could actively 
determine whether the desired show is preempted, a repeat, 
changed in time or programming slot, etc. Thus, the interface 
couki p* eseni niroiTnauon to uic user* oi wnicn ne miuju not do 
aware, and predict an action based on that information. Such a 
device could, if set in n mode of operation that allows such, 
automatically execute a sequence of instructions based on a 
predicted course of action. 

The prospective and real time event characterization unit 2407 
also interacts and receives an input from a telecommunication 
module 24 1 Q, which in turn interacts and receives information 
from an on-line database 241 I. 


241 I. 
2402, 
2405 


160:7-15 
163:9-12 

! 










65. The sysLcm as in 

CUl 1 1 11 \'*t , J ill 1 1 It 1 

comprising men ns for 
^lorin^ an electronic 
program (.wide, 
wherein suid display 
guide highlights 
programs within suid 
e Ice ironic program 
guide which 
correspond ro said 
subset of data. 


Further, if an entire television programming guide lor a week or 
iiiuiuii iiv,uujuic ^ ciawit/fist.. me inicrifice couio actively 
determine whether the desired show is preempted, a repeal, 
changed in time or programming slot, etc. 

To eliminate the possibility of the user trying to make selections 
on merely informative help screens, the cursor, in these cases, 
should be locked to a choice which reUirns the user to where they 
left off in the programming sequence, and this choice should be 
h it'h lighted. 


241 1, 
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